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SPECIFICATIONS 

TITLE OF THE INVENTION 

^Con tents Sum marizin g Unit an d^ Content^ Summarizing Progr am 

FIELD OF THE ART 

This invention relates to a contents summarizing unit 
and a contents summarizing program that produce contents 
summary information summarized from contents regarding 
sports such as a material image prior to broadcasting, a 
program that is on the air or an image recorded by a 
recording media. 

BACKGROUND ART 

Recently, digital image information that a user can 
use in various fields has been steadily growing. In 
conjunction with development of the Internet society, 
computer equipment, communication environment and/or 
interface has been speeded up in a broader area, and various 
image data has been accumulated ubique in large quantity, 
which gives more importance to image summarizing technology 
that makes it possible to access flood of information and to 
watch only a part that a user wants to watch or a 
highlighted part in a short period of time. This kind of the 
image summarizing technology can be classified into the 
following two. 

The first technology extracts a low level 
characteristic amount that is obtained from various media 
such as a color or texture, a camera work, a face of a 
person, a caption, nature or magnitude of sound, TFIDF about 
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written data and so on, from an image by means of an 
automatic analysis, and specifies an important scene by 
means of these combination or time change, and especially 
this technology is frequently applied to an image having a 
5 structure of a relatively comprehensible context such as 
news image . 

The second technology designs an index in association 
with the contents to be easily handled by allowing data 
necessary for summarizing contents to be input by hand to a 

10 large extent, and produces and makes use of it, then if once 
input of the data is completed, the index that expresses a 
flow of a context or each characteristic scene can be 
utilized, which makes it possible to summarize the contents 
that is flexible and that meets a purpose. 

15 However, since the first technology is fundamentally 

based on a low-level characteristic, it is difficult to 
specify semantic concrete contents such that what each scene 
expresses. . In addition, in accordance with the second 
technology, a range to which this technology is applied is 

20 limited and this technology requires some artifice to 
alleviate cost or burden due to manpower. 

DISCLOURE OF THE INVENTION 

In order to solve the above-mentioned problems, the 
25 present claimed invention devices a following means. 

More concretely, the present claimed invention is a 
contents summarizing unit that extracts a characteristic 
motion of a player during a match from contents regarding 
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sports such as a program that is on the air, a material 
image prior to broadcasting, an image recorded by a 
recording media such as a video tape recorder and summarizes 
it in a required time period so that it can be watched in 
5 the required time period, and is characterized by comprising 
an event information obtaining part that obtains event 
information such as the characteristic motion of the player 
during the match from the above-mentioned contents, an 
inside expressing information producing part that produces 

10 inside expressing information describing an outline of the 
match based on the event information, a surface sentence 
information producing part that produces surface sentence 
information expressed by a sentence that summarizes the 
contents based on the inside expressing information, and a 

15 contents summary information outputting part that outputs 
contents summary information wherein the surface sentence 
information is associated with image information 
corresponding to the event information. 

In accordance with the arrangement, since the inside 

20 expressing information producing part produces the inside 
expressing information that expresses an outline of the 
development of the match of the event information such as a 
characteristic motion of the player during the match 
obtained by the event information obtaining part, the 

25 surface sentence information producing part produces the 
surface sentence information expressed by a sentence that 
summarizes the contents based on the inside expressing 
information, and the contents summary information outputting 
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part outputs the contents summary information wherein the 
surface sentence information is associated with the image 
information corresponding to the event information, it is 
possible to provide the contents summarizing unit that 
5 easily produces the contents summary information including 
semantic contents without unnecessary manpower. 

Especially, in order to produce summary information 
corresponding to an interest or preference of a user, it is 
preferable that a user information receiving part that 

10 receives user information showing an interest or preference 
of a user is arranged and that the surface sentence 
information producing part produces the surface sentence 
information wherein the interest or preference of the user 
is reflected in the inside expressing information based on 

15 the user information. 

In order to effectively obtain a sentence that 
expresses a summarized contents, it is preferable that a 
text element for summary storing part that stores a text 
element for summary comprising a word that can express the 

20 development of the match or the motion of the player of the 
contents concerned is comprised and that the surface 
sentence information producing part produces the surface 
sentence information based on the text element for summary. 
In order to make it possible to grasp a motion of a 

25 player or a condition of a match at an arbitrary time during 
the match, it is preferable that the event information has a 
hierarchical structure based on a unit that can describe the 
match such as a structure on a rule of the sports concerned 
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or the motion of the player, and further it is preferable 
that the event information includes match elapsed time 
information showing progress of the match. 

In order to make it possible for the user to 
5 preferably grasp development of the match of the summarized 
contents, it is preferable that the contents summary 
information output by the contents summary information 
outputting part is sorted based on an order of the 
hierarchical structure or the match elapsed time. 

10 In addition, as a preferable summarizing portion of 

the contents, it is preferable that the event information is 
so arranged to include at least either one of score 
information that shows a score or a record, or play event 
information that shows a characteristic motion of each 

15 player. 

In order to provide the user with the contents summary 
information by compiling it within a time period requested 
to watch by the user, it is preferable that the user 
information receiving part is so arranged to receive the 

20 time period requested to watch by the user, that a summary 
time period checking part that compares the time period 
requested to watch by the user received by the user 
information receiving part with a total time period of the 
contents summary information output by the contents summary 

25 information outputting part is arranged, and if the summary 
time period checking part judges that the time period 
requested to watch by the user is smaller than the total 
time period of the contents summary information, the 
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contents summary inf ormation outputting part compiles the 
contents summary information to be summarized within the 
time period requested to watch by the user based on the 
interest and/or preference of the user received by the user 
5 information receiving part and outputs it. 

Furthermore, in order to grasp which player developed 
the match advantageously, it is preferable that a leading 
degree information producing part that compares score 
information of one player with score information of the 

10 other player at an arbitrary elapsed time of the match based 
on the score information and produces leading degree 
information that expresses a leading degree during 
development of the match between the above-mentioned one 
player and the other player is arranged, and that the inside 

15 expressing information producing part produces the inside 
expressing information based on the leading degree 
information, and furthermore it is preferable that the 
leading degree information is information wherein leading 
degree information at the arbitrary elapsed time of the 

20 match is cumulated. 

In order to obtain contents summary information that 
concretely corresponds to an interest or preference of a 
user such as a scene including a motion of a player who 
scored a point just before the match is ended or a scene 

25 that is summarized with centering on a focused player, it is 
preferable that the surface sentence information producing 
part produces the surface sentence information by 
classifying it into surface sentence match development 
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information in association with the development of the match 
expressed by the inside expressing information and surface 
sentence player motion information in association with the 
distinguished motion of the player. 
5 As a preferable mode of the present claimed invention 

represented is a contents summarizing unit that extracts a 
characteristic motion of a player that shows development of 
a match from contents regarding sports of a program that is 
on the air, of a material image prior to broadcasting, or of 

10 an image recorded by a recording media such as a video tape 
recorder and summarizes it in a required time period so that 
it can be watched in the required time period, 
- and characterized by comprising an event information 
obtaining part that obtains score information showing a 

15 point or a record and play event information showing a 
characteristic motion of each player as being event 
information from the above-mentioned contents, a leading 
degree information producing part that compares score 
information of one player with score information of the 

20 other player at an arbitrary elapsed time of the match based 
on the score information and produces leading degree 
information that expresses a leading degree during 
development of the match between the above-mentioned one 
player and the other player, an inside expressing 

25 information producing part that produces inside expressing 
information describing an outline of the development of the 
match based on the leading degree information, a surface 
sentence information producing part that produces surface 
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sentence information expressed by a sentence that summarizes 
the contents based on the inside expressing information, and 
a contents summary information outputting part that outputs 
contents summary information wherein the surface sentence 
5 information is associated with image information 
corresponding to the event inf ormation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an equipment configuration diagram of a 
10 contents summarizing unit in accordance with an embodiment 
of the present claimed invention. 

Fig. 2 is a functional block diagram in accordance 
with this embodiment. 

Fig. 3 is a diagram showing a stored state of a text 
15 element for summary in accordance with this embodiment. 

Fig. 4 is a flow chart showing a process to produce 
contents summary information in accordance with this 
embodiment . 

Fig. 5 is a functional block diagram of a contents 
20 summarizing unit in accordance another embodiment of the 
present claimed invention. 

Fig. 6 is a diagram of cumulative dominant degree 
information that is graphed out in accordance with this 
embodiment . 

25 Fig. 7 is a flow chart showing a process to produce 

contents summary information in accordance with this 
embodiment . 
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BEST MODES OF EMBODYING THE INVENTION 

<First Embodiments 

A first embodiment of the present claimed invention 
will be explained in detail with reference to Fig. 1 through 
5 Fig. 4, wherein contents regarding sports in accordance with 
this embodiment are tennis and contents summary information 
requested by a user is produced from recorded materials that 
have recorded a scene of a match between two players. 

Fig. 1 is an equipment configuration diagram showing 

10 an equipment configuration of a contents summarizing unit 1 
in accordance with this embodiment. Fig. 2 is a functional 
block diagram in accordance with this embodiment. 

The contents summarizing unit 1 in accordance with 
this embodiment extracts a characteristic motion of a player 

15 during the match from contents regarding sports of a program 
that is on the air by a television receiver, of a material 
image prior to broadcasting, or of an image recorded by a 
recording media such as a video tape recorder and produces 
contents summary information summarized into a requested 

20 time period, and mainly comprises, as shown in Fig. 1, an 
input/output interface 11 that is connected with a 
television receiver TV or a record/replay unit such as a 
video tape recorder, an external memory unit 12 or an 
internal memory 13 such as an HDD that memorizes data or 

25 programs, a CPU 14 that is activated in accordance with a 

program memorized in the external memory unit 12 or the like 
so as to work as the contents summarizing unit 1, and a user 
interface 15 such as a keyboard or a mouse that receives 
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user information from a user. "Contents'' here are set as a 
general tennis program that includes an image including a 
motion of a player, a shot filmed at an angle from above so 
that a tennis court is filmed longwise and a shot of a judge 
5 or audiences taken in close-up, and voice of commentators or 
the like. 

Next, the contents summarizing unit 1 will be 
explained in terms of function. When the CPU 14 is activated, 
the contents summarizing unit 1 serves as, as shown in Fig. 

10 2, an event information obtaining part 101, an inside 

expressing information producing part 102, a text element 
for summary storing part 103, a user information receiving 
part 104, a surface sentence information producing part 105, 
a contents summary information outputting part 106, and a 

15 summary time period checking part 107. 

Each component will be explained. 

The event information obtaining part 101 obtains event 
information that shows a characteristic motion of a player 
during a match from the contents and makes use of the 

20 ' input /output interface 11. In this embodiment, the event 
information is obtained by identifying a motion of the 
player such as a forehand stroke based on a positional 
relationship between the player and the ball extracted from 
image information of the contents by means of a binary image 

25 processing or the like. The obtained event information is so 
arranged to have, a hierarchical structure based on a unit 
that can describe a match such as a structure on a rule of 
the sports concerned or a motion of a player, and match 
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elapsed time information that shows progress of the match, 
and output to the inside expressing information producing 
part 102. 

The inside expressing information producing part 102 
5 produces inside expressing information that describes an 
outline of the match based on the event information. More 
concretely, for example, a characteristic motion of a player 
such as a service ace or a double fault is evaluated with 
respect to each game or each set, and inside expressing 

10 information regarding development of the match such as "The 
game had a lot of service aces", or "The set had a lot of 
double faults" is produced . 

The text element for summary storing part 103 stores a 
text element for summary consisting of phrases that can 

15 express development of a match or a motion of a player -of 

the contents and is formed by making use of a predetermined 
area of the external memory unit 12 and the internal memory 
13. In this embodiment, the text element for summary is 
stored in correspondence with a text element for summary ID 

20 that shows a unique value in this contents summarizing unit 
1, as shown in Fig. 3. 

The user information receiving part 104 receives user 
information that shows an interest or preference of a user 
such as a contents structure regarding contents of the match 

25 that the user requests to watch in a summarized state, a 
player on which the user focuses attention in order to 
designate a player or a team upon which the user places 
emphasis, or a summary time period that shows a time period 



that the user requests to watch in a summarized state, and 
the user information receiving part 104 is composed by 
making use of the user interface 15. 

The surface sentence information producing part 105 
produces surface sentence information expressed by a 
sentence that summarizes the contents based on the text 
element for summary and the user information. In addition, 
on an occasion when the surface sentence information is 
produced, an expression that centers on the above-mentioned 
focused player is used based on the user information. As a 
result, the surface sentence information is formed by being 
expressed from a view point of the designated player or team. 

The contents summary information outputting part 106 
outputs contents summary information wherein the surface 
sentence match development information and the surface 
sentence player motion information are associated with image 
information in correspondence with the event information to 
the television receiver TV. As an image in association with 
the surface sentence match development information, a scene 
including the last stroke event of the player who gets a 
point just before the end of the set or the game, or a scene 
including a motion event that happens most frequently in all 
games that are judged as a close game or a one-sided game is 
set to be selected from each set. In addition, as an image 
in association with the surface sentence player motion 
information, motions similar to a super play such as a 
passing shot or a service ace are placed in an order in 
advance and the development of the match and a motion event 
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of a player corresponding to the focused player are set to 
be selected from each set in an ascending order. Furthermore, 
a scene with which the designated player or team is mainly 
associated is weighted and selected from image scenes 
including a characteristic event. In addition, in this 
embodiment, the contents summary information is set to be 
output in an order of a hierarchical structure that shows a 
unit that can describe the match such as a structure of a 
rule of the sports concerned or the motion of the player, or 
the match elapsed time information that shows progress of 
the match in a sorted manner. 

The summary time period checking part 107 compares the 
time period requested by the user that is received by the 
user information receiving part 104 with total time period 
of the contents summary information output by the contents 
summary information outputting part 106, and in case that 
the summary time period checking part 107 judges that the 
time period requested by the user is smaller than the total 
time period of the contents summary information, the summary 
time period checking part 107 gives an instruction to the 
contents summary information outputting part 106 to compile 
the contents summary information based on the interest and 
preference of the user received by the user information 
receiving part 104 so that the contents summary information 
can be summarized within the time period requested by the 
user and output it to the contents summary information 
outputting part 106. 

Next, a movement of the contents summarizing unit 1 in 
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accordance with this embodiment will be explained by the use 
of a flow chart shown in Fig. 4. 

Fig. 4 is a flow chart that shows a process to produce 
contents summary inf ormation requested by a user from a 
5 recorded material where a match between players Oka and 
Hinomura who are playing a tennis match is recorded. 

First, when the event information obtaining part 101 
obtains event information from the recorded material that is 
replayed by the record/replay unit (Step S101) , the inside 

10 expressing information producing part 102 produces inside 
expressing information that expresses development of the 
match (Step S102) . The surface sentence information 
producing part 105 produces surface sentence information 
based on the inside expressing information, the user 

15 information received by the user information receiving part 
104, and the text element for summary stored in the text 
element for summary storing part 103 (Step S103) . More 
concretely, in this step S103, if the received user 
information is, for example, contents configuration = place 

20 emphasis upon a service ace, a focused player = Oka, and 
summary time period = 30 (sec), surface sentence player 
motion information, wherein an emphasis is placed upon the 
service ace and attention is focused on the player Oka, is 
produced such as "In the first set ("dai ichi set ha")", 

25 "Oka scored service aces successively 7 ', "the player Oka won 
the set 6-2 without precariousness . ", "Although Hinomura 
scored a service ace in the second set" "development of the 
set was almost close" "the player Oka finally won the set 6- 
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4.". In the produced surface sentence information "In the 
first set ("dai ichi set ha")", each of "dai" "set" "ha" is 
produced with reference to the text element for abstract 
ID000, 001, 009 respectively. In addition, if the user 
5 information is content configuration = place emphasis upon a 
double fault, a focused player = Oka, and summary time 
period = 30 (sec) , surface sentence player motion 
information, wherein an emphasis is placed upon a 
characteristic motion and attention is focused on the player 

10 Oka, is produced such as "Although the first set began with 
Oka's double fault", "Hinomura double faulted successively", 
"the player Oka won the set 6-2 without precariousness . ", 
"Although Oka's double faults were distinguished in the 
second set,", "Oka played stably without double fault in the 

15 last half", "the player Oka finally won the set 6-4.". 

As mentioned above, the contents summary information 
outputting part 106 compiles the contents summary 
information with which the image information corresponding 
to the event information is associated based on the surface 

20 sentence information produced by the surface sentence 

producing part 105 (Step S104), and the summary time period 
checking part 107 compares the time period requested by the 
user to watch received by the user information receiving 
part 104 with the total time period of the contents summary 

25 information output by the contents summary information 
outputting part 106, and in case that the summary time 
period checking part 107 judges that the time period 
requested by the user is bigger than the total time period 
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of the contents summary information (Step S105) , the 
contents summary information which the image information 
corresponding to the event information is associated with is 
output to the television receiver TV and so on (Step S106) , 
5 and in case that the summary time period checking part 107 
judges that the time period requested by the user is smaller 
than the total time period of the contents summary 
information (Step S105) , the contents summary information 
outputting part 106 compiles the contents summary 

10 information based on the interest and preference of the user 
received by the user information receiving part 104 so that 
the contents summary information can be summarized within 
the time period requested by the user (Step S104) . In 
addition, when the contents summary information is replayed, 

15 the surface sentence information (corresponding to one line 
enclosed by in the above-mentioned example) is displayed 
in sync with each image scene corresponding to the surface 
sentence information on the television receiver TV and a 
digested version can be watched. 

20 In accordance with the above-mentioned contents 

summarizing unit 1, since the inside expressing information 
producing part 102 produces the inside expressing 
information that expresses an outline of the development of 
the match of the event information such as a characteristic 

25 motion of the player during the match obtained by the event 
information obtaining part 101, the surface sentence 
information producing part 105 produces the surface sentence 
information expressed by a sentence that summarizes the 
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contents based on the inside expressing inf ormation, and the 
contents summary information outputting part 106 outputs the 
contents summary information wherein the surface sentence 
information is associated with the image information 
corresponding to the event information, it is possible to 
provide the contents summarizing unit 1 that produces the 
contents summary information including semantic contents 
that the motion of the player at an arbitrary time period 
during the match or a state of the match can be grasped or 
the development of the match as the summarized contents can 
be preferably grasped. 

In addition, if a focused player received by the user 
information receiving part 104 is changed, it is possible to 
effectively produce and provide the contents summary 
information having summarized contents in accordance with 
the preference of the user with keeping a current of the 
context by reference to the text element for summary 
receiving part 103. 

Furthermore, it is possible for the user to enjoy the 
summarized contents within a time period that the user hopes 
to watch. 

In this embodiment, the contents to be summarized is 
tennis, however, it may be other sports such as badminton or 
pingpong . 

In addition, in this embodiment, the contents summary 
information is output to the television receiver TV, however, 
it is not limited to this and other output method may be 
conceived that the contents summary information is output to 
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a record/replay unit such as a video tape recorder and so on 
and recorded by a proper recording media. 
<Second embodiment> 

A second embodiment of the present claimed invention 
will be explained with reference to Fig. 5 through Fig. 7 , 
wherein contents concerning sports of this embodiment are 
tennis and contents summary information requested by a user 
is produced from a program broadcasting a scene of a match 
between two players . 

Since the contents summarizing unit 1 in accordance 
with this embodiment has the same arrangement as that of the 
contents summarizing unit 1 explained in the first 
embodiment, an explanation will be omitted. Fig. 5 is a 
functional block diagram of the contents summarizing unit 1 
in accordance with this embodiment. 

The contents summarizing unit 1 will be explained in 
terms of function. When the CPU 14 or the like is activated, 
the contents summarizing unit 1 serves as, as shown in Fig. 
5, an event information obtaining part 101, a leading degree 
information producing part 111, an inside expressing 
information producing part 102, a text element for summary 
storing part 103, a user information receiving part 104, a 
surface sentence information producing part 105, a contents 
summary information outputting part 106, and a summary time 
period checking part 107. 

Each component will be explained, wherein the same 
name and the same code is given to the component that 
produces the same operation and effect as that of the first 
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embodiment and an explanation will be omitted. 

The event information obtaining part 101 obtains event 
information such as a motion of a player showing 
characteristic development of a match and score information 
5 showing a point or a record from the above-mentioned 

contents and makes use of the input/output interface 11. In 
this embodiment also, the event information is obtained like 
the above-mentioned first embodiment by identifying a motion 
of a player such as a forehand stroke based on a positional 

10 relationship between the player and the ball extracted from 
the image information of the contents by means of a binary 
image processing or the like. The score information is 
obtained from the score displayed in the image input by hand. 
The obtained event information and score information are so 

15 arranged to have a hierarchical structure based on a unit 
that can describe a match such as a structure on a rule of 
the sports concerned or a motion of a player, and match 
elapsed time information that shows progress of the match, 
and is output to the leading degree information producing 

20 part 111 and the inside expressing information producing 
part 102. 

The leading degree information producing part 111 
compares the score information of one player with the score 
information of the other player at an arbitrary match 
25 elapsed time based on the score information obtained by the 
event information obtaining part 101 and produces leading 
• degree information of a set or leading degree information of 
a game (hereinafter called "leading degree information") 
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that shows a leading degree of a set or a game between one 
player and the other player. The leading degree information 
of the set is an index that shows which player develops the 
set advantageously at the arbitrary set and is defined in 
5 terms of an expression Ss=dsi/dsmax. Wherein dsi is a 

difference of a number of games between the winner and the 
loser when the winner wins the last one game of the set, and 
dsmax is a maximum difference of a number of games between 
the winner and the loser until the winner wins the last one 
10 game of the set. In addition, the leading degree information 
of the game is an index that shows which player plays the 
game advantageously at an arbitrary game and is defined in 
terms of an expression Sg=dgl/dgmax. Wherein dgi is a 
difference of a number of points between the winner and the 
15 loser when the winner scores the last one point of the game, 
and dgmax is a maximum difference of a number of points 
between the winner and the loser until the winner scores the 
last one point of the game. 

Furthermore, cumulated leading degree information that 
20 can be obtained by cumulating the leading degree information 
of the game for each game at a time during a match is 
produced and which player develops the set or the game 
advantageously is shown. More concretely, the cumulated 
leading degree information is an index showing development 
25 of the match until a certain time and is defined in terms of 
an expression Sr=SSg. In this embodiment, the cumulated 
leading degree information is obtained by cumulating the 
leading degree information of the game, however, it may be 



obtained by cumulating the leading degree information of the 
set. 

The inside expressing information producing part 102 
analyses an outline of the development of the match from the 
leading degree of the match and its transition for each set 
or each game based on the leading degree information 
produced by the leading degree information producing part 
111 and produces the inside expressing information that 
describes the outline of the development of the match. 

More concretely, if the set leading degree information 
Ss is |Ss|^0-2, the development of the match is analyzed to 
be close, if I Ss |^0.6, the development of the match is 
analyzed to be one-sided, and if 0 . 2< | Ss | <0 . 6, the 
development of the match is analyzed to be plain, and the 
inside expressing information that describes the outline of 
the development of the set such as <1> whether the set was 
one-sided or not, <2> whether the set was close or not, or 
<3> whether the set was neither one-sided nor close, but 
plain or not is produced. For example, the leading degree 
information of the set that has ended up with 6-2 is 
Ss=3/5=0.6, and the inside expressing information showing 
that the development of the set was "one-sided" is produced. 

If the game leading degree information Sg is I Sg I ^ 
0.25, the development of the game is analyzed to be close, 
if |Sg|^0.6, the development of the game is analyzed to be 
one-sided, and if 0 . 25< I Sg | <0 . 6, the development of the game 
is analyzed to be plain, and the inside expressing 
information that describes the outline of the development of 
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the game such as <1> whether the game was one-sided or not, 
<2> whether the game was close or not, or <3> whether the 
game was neither one-sided nor close, but plain or not is 
produced. For example, the game leading degree information 
that has ended up with the second deuce is 40-A (4-5, if 
converted into a score), thereby to be Sg=-l/5=-0 . 2 , and the 
inside expressing information showing that the development 
of the game was "close" is produced. Minus in each leading 
degree shows that the other player is advantageous. 

In addition, the cumulated leading degree information 
produces the inside expressing information that describes 
the outline of the development of the match such as <1> 
whether the development of the set is maintained during 
whole of the set or not, <2> whether the development of the 
match changes during the first half • the last half or not, is 
produced based on, for example, an inclination in a graph, 
as shown in Fig. 6, wherein the leading degree information 
of the game for each game is cumulated and displayed. More 
concretely, in Fig. 6, inside expressing information showing 
that a player at a minus side develops the first half of the 
match 1 advantageously and the player a the minus side 
develops the last half of the match 1 completely in a one- 
sided manner is produced for the match 1. At the same time 
period, inside expressing information showing that the match 
1 is almost in an even state during the first half of the 
match 2, a player at a plus side temporarily develops the 
match 1 advantageously and after that the player at the 
minus side develops the middle part of the match 1 
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advantageously, and the player at the plus side develops the 
last half of the match 2 advantageously is produced for the 
match 2 . 

The surface sentence information producing part 105 
5 produces surface sentence information expressed by a 

sentence that summarizes the contents based on the text 
element for summary and the user information. In this 
embodiment, two kinds of the surface sentence information 
are produced for each set; surface sentence match 
10 development information that is associated with the 

development of the match expressed by the inside expressing 
information and surface sentence player motion information 
that is associated with a distinguished motion of the player, 
and for example, in case that the development of the first 
15 set is generally one-sided, the surface sentence match 
development information such as "The player Oka won the 
first set 6-2 without precariousness . " or the surface 
sentence player motion information such as "Although a 
passing shot or a serve-and- volley is scored" is produced. 
20 In addition, an expression centering on the focused player 
is used based on the user information in producing the 
surface sentence information. As a result, the surface 
sentence information is formed by being expressed in terms 
of the designated player or team. 
25 Next, a performance of the contents summarizing unit 1 

in accordance with this embodiment will be explained with 
reference to the flow chart shown in Fig. 7. 

Fig. 7 is a flow chart showing a process of producing 
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contents summary information requested by a user from a 
program wherein a match between the tennis players Oka and 
Hinomura is broadcasted. 

First, when the event information obtaining part 101 
5 obtains the event information and the score information from 
an on-air program broadcasted on the television receiver 
(Step S201), the leading degree information producing part 
111 produces the set leading degree information, the game 
leading degree information, and the cumulated leading degree 
10 information that is made by cumulating the game leading 
degree information for each game (Step S202). Next, the 
inside expressing information producing part 102 produces 
the inside expressing information that expresses the 
development of the match based on the set leading degree 
15 information, the game leading degree information, the 
cumulated leading degree information, and the event 
information (Step S203) . The surface sentence producing part 
105 produces the surface sentence information based on the 
inside expressing information, the user information received 
20 by the user information receiving part 104, and the text 

element for summary stored in the text element for summary 
storing part 103 (Step S204) . 

In this step S204, if the user information is, for 
example, contents configuration - place emphasis upon 
25 development of the match, a focused player = Oka, and 
summary time period - 30 (sec), surface sentence match 
development information, wherein an emphasis is placed upon 
the development of the match and attention is focused on the 
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player Oka, is produced such as "In the first set ("dai ichi 
set ha")" r "Oka developed the match in a one-sided manner", 
"the player Oka won the set 6-2 without precariousness.", 
"Although Hinomura tentatively developed the match 
5 advantageously in the second set" "development of the set 

was almost close" "the player Oka finally won the set 6-4." . 
In the produced surface sentence information "In the first 
set ("dai ichi set ha")", each of "dai" "set" "ha" is 
produced with reference to the text elements for abstract 

10 ID000, 001, 009 respectively. In addition, if the user 

information is content configuration = place emphasis upon a 
distinguished motion, a focused player = Oka, and summary 
time period = 30 (sec) , surface sentence player motion 
information, wherein an emphasis is placed upon a 

15 distinguished motion and attention is focused on the player 
Oka, is produced such as "In the first set, a pashing shot 
or ", "serve and volley was scored, and ahead", "the player 
Oka won the set 6-2 without precariousness . ", "In the second 
set Oka scored a service ace and,", "a stroke ace, but", 

20 "finally the player Oka won the set 6-4.". Furthermore, if 
the user information is content configuration = place 
emphasis upon a distinguished motion, a focused player = 
Hinomura, and summary time period = 30 (sec) , surface 
sentence player motion information, wherein an emphasis is 

25 placed upon a distinguished motion and attention is focused 
on the player Hinomura, is produced such as "In the first 
set, although Hinomura scored serve and volley and", "a 
service ace so that Hinomura showed a good play", "the 
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player Oka won the set 6-2 without precariousness/', "In the 
second set, although Hinomura scored a pashing shot and,", 
"a stroke ace so that Hinomura showed a good play", "the 
player Oka finally won the set 6-4.". 
5 As mentioned above, the contents summary information 

outputting part 106 compiles the contents summary 
information with which the image information corresponding 
to the event information is associated based on the surface 
sentence information produced by the surface sentence 

10 producing part 105 (Step S205) , and the summary time period 
checking part 107 compares the time period requested by the 
user to watch received by the user information receiving 
part 104 with the total time period of the contents summary 
information output by the contents summary information 

15 outputting part 106, and in case that the summary time 
period checking part 107 judges that the time period 
requested by the user is bigger than the total time period 
of the contents summary information (Step S206) , the 
contents summary information which the image information 

20 corresponding to the event information is associated with is 
output to the television receiver TV and so on (Step S207), 
and in case that the summary time period checking part 107 
judges that the time period requested by the user is smaller 
than the total time period of the contents summary 

25 information (Step S206) , the summary time period checking 
part 107 gives an instruction to the contents summary 
information outputting part 106 to compile the contents 
summary information based on the interest and preference of 
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the user received by the user information receiving part so 
that the contents summary information can be summarized 
within the time period requested by the user and to output 
it (Step S205) . In addition, when the contents summary 
5 information is replayed, the surface sentence information 
(corresponding to one line enclosed by in the above- 
mentioned example) is displayed in sync with each image 
scene corresponding to the surface sentence information on 
the television receiver TV so that the digested version can 

10 be watched . 

In accordance with the above-mentioned contents 
summarizing unit 1, since the inside expressing information 
producing part 102 produces the inside expressing 
information that expresses the outline of the development of 

15 the match based on the event information such as the 
characteristic motion of the player that shows the 
development of the match or the score information obtained 
by the event information obtaining part 101, the surface 
sentence information producing part 105 produces the surface 

20 sentence information expressed by a sentence that summarizes 
the contents based on the inside expressing information, and 
the contents summary information outputting part 106 outputs 
the contents summary information wherein the surface 
sentence information is associated with the image 

25 information corresponding to the event information, it is 
possible to provide the contents summarizing unit 1 that 
produces the contents summary information including semantic 
contents such that which player developed the match 
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advantageously can be precisely known easily without 
unnecessary manpower. 

The method for obtaining the score information by the 
event information obtaining part is to input the score 
5 displayed on the image by hand in the above embodiment , 
however, it is not limited to this and may have an 
arrangement wherein a score is obtained by automatically 
analyzing the score displayed on the image or obtained based 
on acoustic information by a commentator or the like. 

10 In addition, the leading degree information is 

produced based on the score information in the above 
embodiment, however, it is not limited to this and may be 
produced based on a combination of the score information and 
the acoustic information by a commentator and so on. 

15 Furthermore, in the above embodiment, the 

characteristic motion of the player during the match is 
extracted from contents regarding sports of a program that 
is on the air by a television receiver, of a material image 
prior to broadcasting, or of an image recorded by a 

20 recording media such as a video tape recorder, or of a 

material recorded by a recording media, and summarized in 
the time period requested by the user so that it can be 
viewed within the time period, however, the media as being 
an object of the contents to be summarized is not limited to 

25 this and may be such that a characteristic motion during a 
match is extracted from a material image of the sports 
filmed in a stadium prior to broadcasting or image 
information archived on the Internet and summarized in the 
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time period requested by the user so that it can be viewed 
within the required time period. 

Concrete arrangement of each part is not limited to 
the above-described embodiment and may be variously modified 
5 without departing from a spirit of the present claimed 
invention. 

POSSIBLE APPLICATIONS IN INDUSTRY 

As mentioned above, in accordance with the present 

10 claimed invention, since the inside expressing information 
producing part produces the inside expressing information 
that expresses the outline of the development of the match 
of the event information such as the characteristic motion 
of the player during the match obtained by the event 

15 information obtaining part, the surface sentence information 
producing part produces the surface sentence information 
expressed by the sentence that summarizes the contents based 
on the inside expressing information, and the contents 
summary information outputting part outputs the contents 

20 summary information wherein the surface sentence information 
is associated with the image information corresponding to 
the event information, it is possible to provide the 
contents summarizing unit that produces the contents summary 
information including semantic contents easily without 

25 unnecessary manpower. 



